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Soundprocessing, how we do it in Norway 
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The Sensorbow project at NMH 

• Research project at the Norwegian Academy of Music 
together with NOTAM, with the aim to enhance string 
instruments by motion sensing of the bow. 

• As part of the project, a sensorbow was developed at 
NOTAM that contains accelerometers, gyroscopes, a 
finger pressure sensor and 2 buttons. 





* Bowsense, as a spinoff, is hopefully useful in other 
projects as well. 
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Other Bow Projects 

• Hyperbow (MIT / Diana Young) 

• Augmented Violin Project (IRCAM / Bevilacqua) 

• K-Bow (Keith McMillen) 

... some drawbacks in all of them ... 

• We needed to develop ourselves. 
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What we needed 


• light & small 

• wireless 

• measure acceleration and angular rate 

• expandable with external sensors 

• simple design 
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What we made 


• light & small: 40x20mm, 12g including battery 

• wireless 

• measure acceleration and angular rate 

• expandable with external sensors 

• simple design 
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What we made 


• light & small: 40x20mm, 12g including battery 

• wireless: Bluetooth 

• measure acceleration and angular rate 

• expandable with external sensors 

• simple design 
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What we made 


• light & small: 40x20mm, 12g including battery 

• wireless: Bluetooth 

• 3D accelerometer + 3D gyroscope 

• expandable with external sensors 

• simple design 
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What we made 


• light & small: 40x20mm, 12g including battery 

• wireless: Bluetooth 

• 3D accelerometer + 3D gyroscope 

• expandable with 4 external sensors 

• simple design 
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What we made 


• light & small: 40x20mm, 12g including battery 

• wireless: Bluetooth 

• 3D accelerometer + 3D gyroscope 

• expandable with 4 external sensors 

• simple design: Microcontroller contains 12bit A/D 
converter, no OpAmps needed, hand solderable 
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What we made 


• light & small: 40x20mm, 12g including battery 

• wireless: Bluetooth 

• 3D accelerometer + 3D gyroscope 

• expandable with 4 external sensors 

• simple design: Microcontroller contains 12bit A/D 
converter, no OpAmps needed, hand solderable 

• open hard- and software 
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Battery Charger 


Accelerometer (X,Y,Z) 

Bluetooth Transceiver 


Battery Charger LEDs 
Debugging Interface 

External Supply Connector 


The Hardware 


Expansion Contacts 


Gyroscope (Z) 
Microcontroller 

Gyroscope (X,Y) 
Status LED 


F switch 


Battery Contacts 
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Hardware Characteristics 


Functionality 

Component 

Data 

Microcontroller 

C8051F530 (Silabs) 

256Byte RAM, 8kByte 
Flash, 12bit A/D, 

25MIPS 

Accelerometer 

ADXL330 (Analog Devices) 

range +- 3g 

Gyroscopes 

X/Y: IDG300 (Invensense) 

Z: LISY300AL (ST) 

range +- 500°/s 
range +- 300°/s 

Bluetooth 

RN41 (Roving Networks) 

range <= 100m 

Battery 

LPP402025 (Varta) 

Li-Polymer, 

150mAh capacity 


Runtime from fully charged battery: 2..2.5h 
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Firmware 


... consists of: 

• Measurement of sensor voltages 

• Scaling to physical unities 

• Gravity estimator 

• Data transfer into bluetooth module 
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Gravity Estimator 


• implemented using 32bit integer arithmetics 

• runs on bowsense (8bit microcontroller) in realtime 

• simpler than a Kalman Filter 

• allows auto calibration of angular rate 
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Gravity Estimator 


• Rotation matrix for rotation around X axis: 



1 0 

0 cos a 
0 sina 



... converges for small rotations to: 

/ i ° 0 \ 

R= 0 1 -a \ 

\0 a 1 / 
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Gravity Estimator 

• Small rotation around 3 axes: 


/ 1 -7 (3 \ 

R = I 7 1 —a 1 

y —f3 a 1 ) 
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Gravity Estimator 


• Now use this in an iterative calculation: 




—a 


1 


J g + ea 


(the term ea has the effect of a lowpass, and attracts g to a) 
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Gravity Estimator 


• Instead of a lowpass, add to rotation: 



1 -(7 + ^3) (/3 + 6 2 ) 

(7 + 63) 1 -(a + ei) 

— (/? + € 2 ) (cr + Cl) 1 


with (ei, 62 , 63 ) =small rotation towards a 
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Gravity Estimator 


• Now, do this: 


/ 1 -(7 + e 3 ) 

g' = I (7 + €3) 1 

\ — ((3 £2) (cze 1 ) 


... and scale to unity length. 


(P + ^ 2 ) 

— (cr + ei) 

1 
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Calibration 


• Angular Rate: 

• offset is removed by lowpass 

• scale is adjusted by gravity estimator 

• Acceleration: 

• offset is removed by attracting the acceleration vector to 
a sphere with radius=lg 

• scale is hardcoded 
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Data T ransfer 


• simple binary protocol, fixed packet length: 


Header 

Data 

Footer 

0x23 0x40 

wordO, wordl,... 

0x24 


• sent via Bluetooth Serial Port Profile (SPP) 

• received via rfcomm device 

• converted to OSC by standalone app (readbow) 
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Connecting bowsense to the App 


via OSC ... 


bowsense 


s 

© (bluetooth) 


rfcomm 
^ (serial) 
read bow 

\ (OSC) 


Application 



T 


...or directly 


bowsense 


© 

© (bluetooth) 

© 

rfcomm 


(serial) 
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Three words about Bluetooth 

• the good: 

• standardised and readily available 

• supported by all major operating systems 

• theoretical range 100m 

• the bad: 

• range depends on data rate 

• works differently on Windows, OSX and Linux 

• the ugly: 

• unstable at long range 

• needs long time to start a connection 
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Is open hardware free? 


• The step between design and the actual product is 
steeper for hardware than for software. So how free 
can hardware get? 

• Hardware design documents can be licensed like 
software, but hardware design itself can only be 
protected by patents. So how can we invite to 
collaboration? 


* How to license open hardware? 
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What to do next? 


• evaluate alternatives to bluetooth 
(e.g. Zigbee, WLAN) 

• improve receiver software 

• evaluate other sensors 

• use with other musical instruments 

• investigate other uses 
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Any Questions? 
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